02. Constant Weights
2 Constant Weights V1
Reflect
QUESTION:
How might you better define initial weights, such that backpropagation will be able to differentiate between weight behaviors?
ANSWER:
It's key to include an element of uniqueness, or randomness ! Better weights might be selected randomly from within a specified range. By adding variety and all unique weight values, we can ensure that backpropagation will have different activations to look at in the hidden layers, and it can respond to those differences.